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- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1.704(b). 

Status 
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2a)\Z\ This action is FINAL. 2b)K This action is non-final. 

3) n Since this application is in condition for allowance except for fonnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) ^ Claim(s) 1:9 is/are pending in the application. 
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6) ^ Claim(s) 1^ is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 
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10) K The drawing(s) filed on 11 April 2001 is/are: a)^ accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet{s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) n The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments, see pages 7-9, filed 14 January 2005, with respect to the 
rejection(s)of claim(s) 1 and 6 under 35 USC 102(b) as being anticipated by Register et 
al (USP 5,371,807); claims 2-4 and 7-8 under 35 USC 103(a) as being unpatentable 
over Register et al in view of Wei, Gang et al ("TV program classification based on face 
and text processing"); and claims 5 and 9 under 35 USC 103(a) as being unpatentable 
over Register et al in view of Liou et al (USP 6,580,437) have been fully considered and 
are persuasive. Therefore, the rejection has been withdrawn. However, upon further 
consideration, a new ground(s) of rejection is made in view of Wei, Gang et al, 
previously cited by applicant. The Register reference teaches a system for classifying 
input text, and as per the applicants arguments, does not disclose the reception of an 
audio/video signal corresponding to a program for determining transcript information 
and classifying accordingly. Since Register et al does not disclose each and every 
limitation as set forth in the amended claims 1 and 6, the reference cannot be said to 
anticipate the current invention. Further, since claims 2-5, and 7-9 are dependant upon 
claims 1 and 6, they also cannot be said to be unpatentable in view of the respective 
references. However, after further review, the examiner proposes the new grounds of 
rejection for claims 1-4 and 6-8 under 35 USC 102(e) as being anticipated by Wei, 
Gang et al, previously cited as prior art by applicant. Also, claims 5 and 9 are herein 
rejected under 35 USC 103(a) as being unpatentable over Wei, Gang et al, previously 
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cited by applicant, in view of Wei, Qi et al ("Integrating visual, audio and text analysis for 
news video"), previously cited by examiner. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claims 1-4 and 6-8 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Wei, Gang et al ("TV program classification based on face and text processing"), 
previously cited by applicant. 

To serve as a brief overview, the Wei, Gang reference discloses a system for 
classification of TV programs based on face and text processing. In this instance, the 
face processing does not come into consideration; however, the text processing 
according to extracted transcript information comes into consideration when classifying 
input audio/video programs. Extracted text cues and domain-knowledge are used to aid 
in the classification process. 

Regarding claim 1 , the claimed "method for classification of a program" is met as 
follows: 
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• The claimed step of "receiving an audio/video signal corresponding to the 
program" is met by the statement that "consumers today are receiving 
increased numbers of channels" [page 1345, paragraph 2]. 

• The claimed step of "determining transcript information associated with the 
program using the audio/video signal" is met by the text tracking and ' 
extraction being performed on frames in order to extract and receive text 
from the video signal [page 1346, section 2.2]. 

• The claimed step of "identifying at least one cue of a plurality of cues in 
the transcript information, each of the plurality of cues having associated 
therewith a type of program" is met by the text that is a helpful cue in 
recognizing the type of a TV program [page 1345, paragraph 4]. 

• The claimed step of "correlating the at least one cue of the plurality of 
cues identified in the transcript information to the type of program" is met 
by the inherent correlation between the text cues and the type of a TV 
programs associated with the text cues. The reference states "text is a 
helpful cue in recognizing certain types of TV programs". This 
recognition of the TV program type inherently teaches a correlation 
between the text cue and the TV program type [page 1 345, paragraph 4], 

• The claimed step of "classifying the program based on the correlation of 
the at least one cue of the plurality of cues identified in the transcript 
information" is met by the classification of a TV program into a category 
based on the extracted text cue [page 1345, paragraph 4]. 
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Regarding claim 2, the claimed step of "receiving an audio/data/video signal 
which includes the transcript information" is met by page 1345, section 1, wherein the 
reference discloses the step of receiving an audio/video feed and extracting the 
transcript from the received audio/video feed. 

Regarding claim 3, the claimed step of "noting a time of occurrence during the 
program of the at least one cue and a second cue" is met by the trajectory being used in 
the text tracking method (section 2.2). Wei, Gang utilizes a "text tracking" to track text 
and to consider the text if it falls into an appropriate trajectory. In section 3.1 , the 
reference states, "the number and average duration of the 'survived' trajectories 
constitute additional dimensions in the feature space," The claimed step of "comparing 
the time of occurrence of the at least one cue and the second cue to determine a 
proximity of occurrence of the at least first cue and second cue" is met by the same 
trajectory, which samples different text trackings and establishes, based on duration 
and number, if they should be utilized. The claimed feature "wherein if the proximity of 
occurrence is greater than a predetermined amount, the at least first and second cue 
are ignored in connection with determining the program classification" is met by the 
trajectory and the claimed feature "wherein if the proximity of occurrence is not greater 
than the predetermined amount, the at least first and second cue are utilized in 
connection with determining the classification" is also met by the trajectory, which uses 
the number and average duration to establish which text trackings are utilized for 
classification. 
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Regarding claim 4, the claimed "classification of the program is one of a news 
program, talk show, sports program, panel discussions, interviews, and situational 
comedy" is met by the teaching of four categories, namely news, commercial, sitcom, 
and soap (page 1 345, paragraph 4). He also suggests that the system can be extended 
to recognize more categories by adding new classification rules. 

Regarding claim 6, the claimed "apparatus for classification of a program" is met 
as follows: 

• The claimed "receiver to receive an audio/data/video signal corresponding 
to the program" is met by the statement that "consumers today are 
receiving increased numbers of channels" [page 1 345, paragraph 2]. 

• The claimed "transcript Information extractor for extracting transcript 
information associated with the program from the audio/data/video input 
signal" is met by the text tracking and extraction being performed on 
frames in order to extract and receive text from the video signal [page 
1346, section 2.2]. 

• The claimed "cue extractor for identifying at least one cue of a plurality of 
cues in the transcript information, each of the plurality of cues having 
associated therewith a type of program" is met by the text that is a helpful 
cue in recognizing the type of a TV program [page 1 345, paragraph 4]. 

• The claimed "knowledge database for correlating the at least one cue of 
the plurality of cues identified in the transcript information to the type of 
program" is met by the inherent correlation between the text cues and the 
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type of a TV programs associated with the text cues. The reference states 
"text is a helpful cue in recognizing certain types of TV programs". This 
recognition of the TV program type inherently teaches a correlation 
between the text cue and the TV program type [page 1345, paragraph 4]. 
• The claimed "classifier for classifying the program based on the correlation 
of the at least one cue of the plurality of cues identified in the transcript 
information" is met by the classification of a TV program into a category 
based on the extracted text cue [page 1 345, paragraph 4]. 
Regarding claim 7, the claimed step of "noting a time of occurrence during the 
program of the at least one cue and a second cue" is met by the trajectory being used in 
the text tracking method (section 2.2). Wei, Gang utilizes a "text tracking" to track text 
and to consider the text if it falls into an appropriate trajectory. In section 3.1 , the 
reference states, "the number and average duration of the 'survived' trajectories 
constitute additional dimensions in the feature space." The claimed "temporal database 
used to compare the time of occurrence of the at least one cue and the second cue to 
determine a proximity of occurrence of the at least first cue and second cue" is met by 
the same trajectory, which samples different text trackings and establishes, based on 
duration and number, if they should be utilized. The claimed feature "wherein if the 
proximity of occurrence is greater than a predetermined amount, the at least first and 
second cue are ignored in connection with determining the program classification" is 
met by the trajectory and the claimed feature "wherein if the proximity of occurrence is 
not greater than the predetermined amount, the at least first and second cue are utilized 
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in connection with determining the classification" is also met by the trajectory, which 
uses the number and average duration to establish which text trackings are utilized for 
classification. 

Regarding claim 8, the claimed "classification of the program is one of a news 
program, talk show, sports program, panel discussions, interviews, and situational 
comedy" is met by the teaching of four categories, namely news, commercial, sitcom, 
and soap (page 1345, paragraph 4). He also suggests that the system can be extended 
to recognize more categories by adding new classification rules. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 5 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wei, Gang et al ("TV Program Classification Based on Face and Text Processing"), . 
previously cited by applicant, in view of Wei, Qi et al ("Integrating visual, audio and text 
analysis for news video"), previously cited by examiner. 

Regarding claim 5, the Wei, Gang et al reference discloses all of that which is 
discussed above with regards to claim 1 . The Wei, Gang reference does not disclose, 
"transcript information comprises closed-captioned text". The Wei, Qi reference 
discloses a similar situation to that of Wei, Gang, wherein the text information for 
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classifying a news program comes in the form of close caption text [page 2, paragraph 
2]. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to utilize close caption text as the transcript information for the program to be 
classified, in order to utilize an already existing technology (close captioning) that is 
easy to parse and easy to work with for the purposes of classification. 

Regarding claim 9, the Wei, Gang et al reference discloses all of that which is 
discussed above with regards to claim 6. The Wei, Gang reference does not disclose, 
"transcript information comprises closed-captioned text". The Wei, Qi reference 
discloses a similar situation to that of Wei, Gang, wherein the text information for 
classifying a news program comes in the form of close caption text [page 2, paragraph 
2]. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to utilize close caption text as the transcript information for the program to be 
classified, in order to utilize an already existing technology (close captioning) that is 
easy to parse and easy to work with for the purposes of classification. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael R. Shannon whose telephone number is (571) 
272-7356. The examiner can normally be reached Monday through Friday 8:00 AM - 
5:00PM, with alternate Friday's off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Miller, can be reached at (571) 272-7353. 
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Any response to this action should be mailed to: 

Please address mail to be delivered by the United States Postal Service (USPS) 
as follows: 

Mail Stop 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 2231 3-1 450 

Effective January 14, 2005, except correspondence for Maintenance Fee 

payments, Deposit Account Replenishments (see 1.25(c)(4)), and Licensing and 

Review (see 37 CFR 5.1(c) and 5.2(c)), please address correspondence to be delivered 

by other delivery services (Federal Express (Fed Ex), UPS, DHL, Laser, Action, 

Purolater, etc.) as follows: 



United States Patent and Trademark Office 
Customer Service Window 
Randolph Building 
401 Dulany Street 
Alexandria. VA 22314 

Some correspondence may be submitted electronically. See the Office's Internet 
Web site http://www.uspto.gov for additional information. 

Or faxed to: (703) 872-9306 



Hand-delivered responses should be brought to: 

Knox Building 
501 Dulany Street 
Alexandria, VA 22314 
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Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to customer service whose telephone number is (571) 
272-2600 



Michael R Shannon 
May 19, 2005 



Michael R Shannon 

Examiner 

Art Unit 2614 




^ JOHN MILLER 
SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 



